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Abstract 

This interactive software package provides design solutions for both 
standard linear quadratic regulator (LQR) and suboptimal linear regulator 
problems. Intended for time-invariant continuous systems the package is 
easily modified to include sampled-data systems. LQR designs are obtained by 
established techniques while the large class of suboptimal problems containing 
controller and/or performance index options is solved using a robust gradient 
minimization technique. Numerical examples demonstrate features of the 
package and recent developments are described. 
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Introduction 


In addition to providing CAD solutions to the linear quadratic regulator 
(LQR) problem for time-invariant continuous systems this package offers the 
designer a range of attractive "suboptimal" alternatives. These alternatives 
were first suggested in the early seventies to offset certain disadvantages of 
the LQR approach which include its reliance on full state feedback or state 
reconstruction techniques and its sensitivity to plant specifications. The 
so-called "suboptimal" designs optimize problems which are related to the LQR 
formulation but which are not bound by its restrictive framework. In addition 
to handling the basic LQR design SUBOPT accommodates options which permit both 
alternative controller configurations and performance index (PI) descriptions. 

The design options made available are : 

Controller Options 

Full state feedback 

Output feedback 

. £ 

Dynamic compensation 
PI Options 

* Sensitivity reduction 

-k 

Virtual model-following 

k 

Implicit model following 

One controller option is selected by the designer and may be used simply with 
the conventional PI containing quadratic terms in state and control or an 
extended PI which includes sensitivity reduction and/or model-following 
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terms. With this more flexible design approach it is easy to compare 
different design philosophies within the package. A further feature, the 
"gain-fixing," permits the designer to fix one or more controller parameters 
to have zero or non-zero values. This has proved useful, for example, (i) in 
eliminating redundant gain elements, (ii) for investigating certain failure 
modes and (iii) for realizing minimal parameter compensators. 


Methodology 

Plant parameters are input according to the system description 

x=Ax+Bu,y=Cx 

-p p -p p -p ^p p — p 

and the desired controller configuration is selected: 


(i) 

u = 

K 

x - full state feedback 

-p 

s 

-P 

(ii) 

u = 
-p 

K o 

- output feedback 

(iii) 

c 

11 

A 

c 

Zp + B c ^ " dynamic compensation 


where x =C y +D x,x(0)=0, 

— c c ^p c — c* — c 

is the plant state vector, 
is the output state vector, 
is the control vector and 
is the compensator state vector. 
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Elements of controller gain matrices K g , Kq or A c , B c , C c and D c are the 
minimizing parameters of the PI. 

The conventional quadratic infinite-time PI 

00 

J ** J (y? Q x + R u Idt 
0 ~i> P -p -P P 

is augmented with a quadratic compensator measure if controller configuration 
(iii) is selected. 

It may be augmented further if any of the PI options are selected. If 

sensitivity reduction is an objective a quadratic measure of sensitivity is 

included, based on the sensitivity vector, x = 3x /3a, where a is a varying 

“S — p 

system parameter. If model-following is to be achieved a quadratic measure of 
the difference between plant and model states for virtual model-following 
(VMF) or derivatives for implicit model-following (IMF) replaces the usual 
state measure in the PI, where the model is defined thus: 

• 

x = A x,y = C x, 

-m m — m «^m m —nr 

x is the model state vector and 
— m 

y^ is the model output vector. 

The general suboptimal linear regulator problem (and LQR problem) is 
formulated as follows: 


x = A x 


, x(0) = Xq 


Given the system 
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find the feedback controller, u^, of specified configuration which minimizes 
the PI 

oo 

J = / x Q xdt . 

0 

Vector x may simply contain x p or depending on the option(s) selected 
may be automatically augmented to include x^, 3 ^, and/or x^. Accordingly 
the program builds the appropriate A and Q. 

Option choices which lead to the basic LQR design are identified by the 
program and the resulting matrix Riccati equation is solved using Kleinman's 
iterative techinque [1], Otherwise, the optimization problem is solved using 
a quasi-Newton gradient minimization algorithm to minimize J. Both 
approaches require an initial controller estimate which results in a stable 
system. Such an estimate is usually available; if not, one can be obtained 
within the program package employing the method suggested by Koenigsberg and 
Frederick [2], 

The program realization of the problem formulation permits the 
specification of fixed elements within the controller structure so that not 
all of the controller gain elements need be minimizing parameters: this 

introduces additional flexibility to controller configurations. 

The minimization algorithm fails only if the user-selected convergence 
termination criterion is not satisfied after a prespecified number of PI 
evaluations. Such a failure will occur 

(i) if an insufficient number of PI evaluations have been made in pursuit 
of the solution, or 

(ii) if the termination requirement demands a numerical precision for which 
the particular combination of program package and host machine is 


unsuited 
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A "soft" failure mode has been adopted thus permitting 

(a) immediate re-entry to the routine in the event of (i), using the most 
recent controller estimate, or 

(b) specification of a less stringent termination criterion in the event of 
(ii). 

High precision in the solution is rarely needed when the design goal is viewed 
within the control engineering context. 

An attractive feature of the LQR design approach is that its solution is 
independent of plant initial conditions. If these are unknown the initial 
condition dependency of the suboptimal solution is adequately accommodated by 
permitting the designer to 

(a) minimize J for an average set of initial conditions, 

(b) minimize J for a worst-case set of initial conditions, or 

(c) minimize J, given some statistical knowledge of the initial 
conditions. 


Software Details 

The program package contains robust, efficient numerical algorithms which 
have been thoroughly tested in industrial and academic environments. It is a 
conversational-mode package, having versions in FORTRAN- 10 and FORTRAN 77 with 
the graphics component based on GHOST. Source code is fully commented and the 
software documented [3], [4], Array sizes in code are parameterized in order 
that the user may tailor the program to fit design and host machine 
requirements. Typically, an overall system of order 30 will require 190K 
bytes of executable code (excluding graphics). A typical run-time on a DEC-10 
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machine for a tenth-order suboptimal linear regulator problem having 4 
variable gain elements is 17 seconds. 

Design evaluation tools include closed-loop eigenvalue determination, a 
COST routine to permit investigation of individual components of the PI, e.g., 

00 00 
T 2 

I X % X o dt ° r / U 1 dt ‘ 

0 -s s -S Q I 

and a simulation facility for graphical display of system responses. A series 
of design solutions may be obtained through modification of weighting 
matrices, controller/PI options, etc. The evaluation tools, therefore, 
provide a ready comparison between designs, e.g., contrasting an LQR solution 
with an output feedback design. 


Design Examples 
Helicopter Regulation 

Helicopter longitudinal dynamics are described in [5] for a plant which 

Tr e -)T Tr lT 

has four states, x = [y , p , 0, 9J , and two controls, u = [u., u„J . An 

LQR design, incorporating full state feedback, obtained for 

Q p = diag(0.1 ,0.1 ,0,0) and Rp = diag(0 .01 ,0 .01) , yields a satisfactory model 
response: 

x=fA+BK)x=Ax, 

— ra v p p s'— m m — m 

where u = K x . However, the goal is to satisfactorily regulate u and 
— p s — p x 

y (forward and vertical velocities) employing feedback from only two states, 
z 

0 and 0 (pitch angle and pitch rate), since the use of airspeed sensors for 
y and y is undesirable. 
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Such a design may be effected by minimization of the PI: 



T 

x ) + u R u dt 
— HI — P P — P 


which includes a virtual model-following term and by specifying controller 
feedback from 0 and 0 alone. The VMF term forces this new reduced 
feedback design to closely match the response of the original LQR design. 
Setting Qp and Rp as given above yields controller A: 

0.146 0.074 0 

u = 

-0.279 0.134 0 

and from the resulting responses (see Figure 1) it is clear that reasonable 
regulation can be achieved with comparable control effort to the LQR design 
without resorting to use of velocity sensors. 

Assume now a possible pitch rate sensor failure, in which case we wish to 
maintain reasonable regulation with pitch angle feedback alone. Setting the 
gain elements corresponding to pitch rate feedback to zero and minimizing J 
with respect to the two remaining control gains reveals that although there is 
some degradation in system performance using the resulting controller B: 

0.157 

u = 0 

-0.301_ 

the quality of regulation is still acceptable. Now if we accept this as a 
base or "worst-case" controller an improved controller can be obtained by 
fixing the pitch angle gain elements at these values and minimizing J with 
respect to the pitch rate gain elements. The resulting "robust" controller, 
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0.157 

0.054 


0 

u = 




9 


-0.301 

0.114 



since it will tolerate a pitch rate sensor failure, yields responses which are 
very similar to the responses for controller A. 

Desensitizing a Gas Turbine Engine Controller 

Consider now the regulation of the two spool speeds (X 3 and X 4 ) of a 
twin-spool gas turbine engine. An output feedback control design which 
conforms to rigid engineering constraints, has already been effected for this 
2-control 5-state problem via a nonlinear optimization technique (for details 
and model data, see [ 6 ]). Particular attention has been paid to control 
magnitudes and the step responses of X 3 and X 4 , which must have little or 
no overshoot since overspeeding of the engine rotors will lead to blade 
failure. In this design, however, no account could be taken of plant 
parameter variations. 

The engine is particularly susceptible to variations in the low pressure 

spool speed time constant, x T p (nominal value t TI) ), and its effect on X 3 

is shown in Figure 2(a); variations have little effect on X 4 . When 

t TT3 = 0.5 x Tr) , the low pressure spool speed, Xo, has an unacceptable 
LP LP q 

overshoot, and for x = 1.5 x the response is rather sluggish. The 

LP LP q 

object, then, is to design a controller which is less sensitive to variations 

in x and which will produce a similar nominal response. This nominal 
LP 

response is characterized by a model matrix, A m , derived from the original 
design. 

One approach which suggests itself is to include a sensitivity terra in 
the PI; however, experience has indicated that simple inclusion of this term 
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leads to design difficulties since it can prove difficult to choose suitable 
weighting matrices to simultaneously yield sensitivity reduction and a 
desirable system response. It has been found easier to replace the state term 
by a model-following terra thus: 


= /{<!- 


X ) 
— m 


Q (x - 
P “P 


x ) 

— m 


T 

x 

— s 


T 

+ u R 
-P P 


u }dt . 
-P J 


IMF has been employed here because, although it is less accurate than VMF, it 

leads to a lower-order problem and has the added advantage that Rp may be 

set to zero and PI minimization will still lead to a finite controller, 

thereby releasing the designer from the chore of balancing Q_, Q„, and R_. 

to achieve the desired result. 

Setting Qp = 1000 I 5 and Q s = diag(0 ,0 , 10~* ,0 ,0) leads to the 

controller: 


u = 


0.09 - 8.88 

■13.70 61.44 


x. 


x. 


and the desensitized response for x^ is shown in Figure 2(b). State 

dispersion of x^ is considerably reduced, and the overshoot when 

x = 0.5 x has been eliminated using a controller of comparable size to 

LP LP q 

that used in the original design. 

The performance has been further improved by employing a dynamic 
compensator (see Figure 2(c)): 


u 

“P 


-2.28 

-8.49 


8.61 

37.28 


-0.37 -14.56 

-13.60 7.54 


x 


where 
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• 

1 -8.57' 


X 3 


-3.77 0 

X = 




+ 


— c 

1 -5.76 


x 4_ 


0 -4.32 


x (0) = 0 


which also results in a controller of comparable size. IMF is unsuitable in 
connection with dynamic compensation, so VMF has been implemented in this case 
where the PI is 


J = / {(v -y) T Q(y -y)+x T Q x 
q ^-p -Mn p — p -Hn — s s — £ 


T 

+ u R u + x 

-P P -P -c 


R x }dt. 
c — c ‘ 


The controller was found by setting Q p = diag( 3000 ,3000) , Q s = 

diag(0 ,0 , 100 ,0,0) , R p = 100 l£ and R £ = I 2 . (It is necessary for R c to be 
positive definite although its contribution here to the final design is 
negligible.) It will be noted from the controller description above that a 
minimal parameter canonical form has been adopted: using the gain fixing 

facility, elements (1,1) and (2,1) of C c are set to unity and elements 
(1,2) and (2,1) of D c are set to zero prior to minimization. 


Recent Developments 

Both the LQR and suboptimal regulator approaches rely on a trial-and- 
error approach to design in which weighting matrices are adjusted iteratively 
in a design loop until the final goal is realized. In a new approach [7] , the 
linear quadratic constrained regulator (LQCR), the design is recast as a 
constrained optimization problem in which both design objective and 
constraints are quadratic cost functions. This formulation permits the 
separate consideration of, for example, model-following errors, sensitivity 
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measures and control energy as objectives to be minimized or limits to be 
observed. The result is a one-pass design procedure whose solution, which 
includes identification of active constraints at the minimum, reveals useful 
insights into the design problem (see [8]). 

The LQCR technique is available as research code, the software having 
been constructed from the SUBOPT package. Present work is engaged in 
investigating multi-objective optimization strategies in which multiple goals 
are specified and design solutions sought through nonlinear programming 
techniques . 
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